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Abstract. The problem of finding a rank-one solution to a system of linear matrix equations 
arises from many practical applications. Given a system of linear matrix equations, however, such 
a low-rank solution does not always exist. In this paper, we aim at developing some sufficient 
conditions for the existence of a rank-one solution to the system of homogeneous linear matrix 
equations (HLME) over the positive semidefinite cone. First, we prove that an existence condi- 
tion of a rank-one solution can be established by a homotopy invariance theorem. The derived 
condition is closely related to the so-called property of the function defined by quadratic trans- 
formations. Second, we prove that the existence condition for a rank-one solution can be also 
established through the maximum rank of the (positive semidefinite) linear combination of given 
matrices. It is shown that an upper bound for the rank of the solution to a system of HLME over 
the positive semidefinite cone can be obtained efficiently by solving a semidefinite programming 
(SDP) problem. Moreover, a sufficient condition for the nonexistence of a rank-one solution to 
the system of HLME is also established in this paper. 
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1 Introduction 



Let i?" denote the n-dimensional Euclidean space, with the standard inner product, and let S"^ 
denote the set of real symmetric matrices. For a given A G 5", ^4 >; 0) means that A is 
positive semidefinite (positive definite). For two n x n matrices X and Y, {X,Y) = tr(X^y) 
denotes the inner product of X and Y, where tr(-) stands for the trace of a square matrix. We 
use ||X|| and to denote the spectral norm and the nuclear norm (i.e., the sum of singular 

values), respectively, of matrix X. 

Stimulated by the recent work on compressed/compressive sensing (e.g. [22, 21, 14, 15]), the 
study of finding a low-rank solution to optimization problems with linear matrix (in) equality 
constraints has recently become intensive [43, 50]. Many practical problems across disciplines 
(such as sparse signal recovery [21, 15], system control [23, 9, 29, 25, 26], matrix completion 
[12, 13], machine learning [1, 35], quadratic equation [50], Euclidean distance geometry [47, 44, 17] 
and combinatorial optimization [2]) can be formulated as the following problem: 

min{rank(X) : AX = b, X e C} , 

where X is an n x p matrix, 6 is a vector in i?™, A : BJ^^p — > i?™ is a linear operator, and 
C C BT'^P is a convex set. Various heuristic methods for such problems have been proposed 
and investigated (e.g. [25, 43, 34, 46, 3]). Among all low-rank solutions, a rank-one solution is 
particularly useful in many situations, especially in system control and quadratic optimization [23, 
9, 29, 2, 49]. Locating a low-rank solution (especially a rank-one solution) is not only motivated 
by these practical applications, but also motivated naturally by the structure of the solution set 
of semidefinite programming (SDP) problems. In fact, an optimal solution of an SDP problem, 
if attained, usually lies on the boundary of its feasible set. Note that the nontrivial extreme rays 
of the positive semidefinite cone are generated by rank-one matrices. 

However, for a given system of linear matrix equalities, a rank-one solution with a desired 
structure does not always exist. In this paper, we focus on the existence issue of a rank-one 
solution to the homogeneous system: 

(^i, X) =0, z = l,...,m, X^O, (1) 

where ^4^ G S'"', i = 1, . . . , m, are given n x n matrices. This system is referred to as the homoge- 
neous linear matrix equations (HLME) over the positive semidefinite cone. We aim at addressing 
the following fundamental question: When does system (1) possess a rank-one solution? The main 
motivation to the study of the system (1) is that it is closely related to the system of quadratic 
equations (see e.g., [50]): 

x^AiX = 0, i = l,...,m, X e R^. (2) 

Hence it is closely linked to various linear algebra and optimization topics, such as the simultaneous 
diagonalizability of a given set of matrices (^i, . . . ,^m), the convexity property of the field of 
values associated with a finite number of matrices [10, 32, 31, 30], and the widely used 'S-Lemma' 
or 'S-Proccdurc' in system control and optimization [8, 9, 6, 41, 42]. 

In this paper, we investigate the existence of a rank-one solution to the system (1) from the 
viewpoint of nonlinear analysis and rank optimization. Clearly, the system (1) has a rank-one 
solution if and only if (2) has a nonzero solution. Thus, the existence of a rank-one solution of 
the system (1) is equivalent to that of a nonzero solution of the system (2). Except for some 
special cases, however, a general and complete characterization of the existence condition for a 
rank-one solution to the system (1) remains open (see, for instance, the open "Problem 12" and 
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"Problem 13" in [30]). The study of (2) can date back to 1930s. Thanks to the early work of Dines 
[18, 19, 20], Brickman [10], Calabi [11], and the work of Finsler [27], a complete characterization of 
the system (2) with m = 2 and n > 3 is clear: x = is the only solution to the system x^Aix = 
together with A2X = if and only iftiAi +t2^2 >~ for some ti,t2 ^ R- A good survey on the 
historical development of this result can be found in [48, 31, 42]. This result is closely related to S- 
Lemma/S-procedure [41], and related to the approximate S-lemma and low rank issues discussed 
in [5]. It can be related to the trust region subproblem in nonlinear optimization as well (see e.g. 
[45, 37]). 

Let us restate the above classical result as follows, in terms of rank-one solutions to the system 
of HLME over the positive semidefinite cone. We call it "Dines-Brickman's Theorem" . 

Theorem 1.1 (Dines-Brickman) When m = 2 and n > 3, the system 

= 0, (A2,X) = 0, XyQ (3) 
has a rank-one solution if and only if tiAi + i2^2 / for any ti,t2 £ R, in other words, 
max { rank(ti^i + i2^2) : hAi + t2A2 h 0} < n-1. 

tl,t2 



Unfortunately, such a complete characterization does not hold in general for m > 3. The first 
purpose of this paper is to establish a general sufficient condition for the existence of a rank-one 
solution to the system (1) by using a homotopy invariance theorem. To this end, we introduce a 
class of functions called P0, and show that the system (1) has a rank-one solution if the quadratic 
image function has a P0 property. This analysis is the first to link P0-functions and the existence 
of a rank-one solution to the system of HLME over the positive semidefinite cone. The second 
purpose of this paper is to develop an existence condition for the rank-one solution of (1) via a 
rank optimization approach. To this end, we introduce the following rank maximization problem 

f / m \ m ^ 

r* = max < rank > tiAi : > tiAi >~ > , 

which turns out to be an important factor for the existence of a rank-one solution of the system 

(1) (this has already been observed in the aforementioned Theorem 1.1). In section 3, we also 
point out that the value of r*, combined with Barvinok-Pataki's bound [4, 40], can be used to 
determine an upper bound for the rank of the solution of (1). 

It is also important to understand when the system (1) does not have a rank-one solution. In 
other words, we study the question: When is x = the only solution to the quadratic system 

(2) ? This was posted as the open "Problem 13" in [30]. For m > 3, the well-known condition 
YL^i UAi >- does imply that x = is the only solution of the quadratic system (2) (and hence 
the system (1) has no rank-one solution). However, this condition is too strong (see Lemma 3.2 
for details). This motivates us to investigate the above-mentioned open question, and to develop 
another sufficient condition for the nonexistence of a rank-one solution to the system (1) from a 
nonlinear analysis point of view. 

This paper is organized as follows. In section 2, we develop a sufficient condition for the 
existence of a rank-one solution to (1) by using a homotopy invariance theorem. In section 3, we 
establish other sufficient conditions by means of rank optimization. A nonexistence condition for 
the rank-one solution of (1) is provided in section 4, and conclusions are given in the last section. 
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2 Existence of a rank-one solution: homotopy invariance 



Note that any rank-one matrix in a positive semidefinite cone must be of the form X = xx 
with x 7^ 0. Thus the system (1) has a rank-one solution if and only if there is an x 7^ such 
that {Ai^xx'^) = 0, i = 1, . . . ,m, which is nothing but the system (2). By homogeneity, this is 
equivalent to saying that the system (1) has a rank-one solution if and only if there is a solution 
to the system 

x'^AiX = 0, i = 1, . . . ,m, x'^x = 1, (4) 

which has m + 1 equations and n variables. It is worth mentioning that the system (4) is related to 
the structure of the set {x : x^AiX < 1, i = 1, . . . , m} which has been considered by Nemirovski, 
Roos and Terlaky [36]. For instance, if (4) has no solution, then the set {x : x^AiX < 1, i = 
1, . . . , m} contains only a single point a; = 0. 

In this section, we assume that m + 1 <n. Let $ : i?" ^ R"^'^^ be the mapping defined by 

= {x'^Aix, ■ ■ ■ , X^AmX, x^x — 1)^. (5) 

When m -j- 1 < ra, we may introduce the extra matrices A^^i = • • • = An-i = into (1) without 
any change of the system. Thus, without loss of generality, we assume that m -|- 1 = n in the 
remainder of this section so that $(a;) = consists of n equations with n variables. An immediate 
observation is given as follows. 

Lemma 2.1. The system (1) has a rank-one solution if and only if $(a;) = has a solution. 

This observation combined with the next result (homotopy invariance theorem of topological 
degree) is a key to developing our first existence result. For a bounded subset D of i?", D and 
dD denote the closure and the boundary of D, respectively. Let / be a continuous function 
from 'D into i?". For y e R" such that y ^ f{dD) = {f{x) : x G dD}, deg{f,D,y) denotes 
the topological degree associated with /, D and y, which has been widely used in the existence 
analysis of nonlinear equations (see, [39, 33, 38]). The following result is called the homotopy 
invariance theorem. Part (i) is due to Poincare and Bohl, while part (ii) is attributed to Kronecker 
[39, Theorems 6.2.4 and 6.3.1]. 

Lemma 2.2. (Poincare-Bohl-Kronecker) Let D C i?" be a nonempty open bounded set and 
F, G he two continuous functions from D into R^. Let H{x,t) = tG(x) -|- (1 — t)F{x), <t < 1, 
and let y be an arbitrary point in R^. 

(i) Ify ^ {H{x, t) : X e dD andt e [0, 1]}, then deg(G, D, y) = deg(F, L>, y). 

(ii) If y ^ F(dD) and deg{F,D,y) ^ 0, then the equation F{x) = y has a solution in D. 

First, we prove the following technical result. 

Lemma 2.3. // $(x) =0 has no solution, where $ is defined by (5), then there exists a 
sequence {x^} C i?" such that \\x^\\ —>■ 00 as A; —>■ 00, and for each k there exists G (0, 00) such 
that ^{x^) = —j^x^, i.e., x^ satisfies the following relations: 

{x'^fAx'' = -j'^xt i = l,...,m, (6) 
{xY^" = l-7'4, (7) 

where x^ denotes the jth component of x^. 
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Proof. Suppose that = has no solution. Consider the homotopy between the identity 
mapping and i.e., 



'H{x,t) = tx + {1 - t)^{x) 



( txi + (1 - t)x^Aix \ 

tXm + (1 — t)x^ 
\ tXn + {l-t){x'^X-l) J 



Let 



Q = {x G i?" : n{x, t) = for some t e [0, 1]}. 



First, we prove that Q is unbounded. In fact, if Q is bounded, then there exists an open bounded 
ball D C R"' that contains the set Q, and D can be chosen large enough so that the boundary 
dD does not touch the set Q, i.e., dD fl Q = 0- By the definition of Q, we deduce that 

^ {H{x, t): xedD, < t < 1}. 

(Indeed, if is an element of the above set, then T-L{x, t) = for some x G dD and t G [0, 1], which 
implies dDf] Q / 0, a contradiction.) Thus, dcg{I,D,0) and deg(<I', D, 0) are well defined, and 
by Lemma 2.2 (i), we have 

deg($,AO) = deg(/,L»,0). 

For the identity mapping, we have | deg(/, -D, 0)| = 1. Thus, we have deg($, D, 0) ^ 0, which along 
with Lemma 2.2 implies that there exists a solution to <I>(.t) = 0, contradicting the assumption. 
So Q must be unbounded, and there exists an unbounded sequence {x^} in Q. Without loss of 
generality, let x'' ^ for all k, and Hx'^H ^ oo as A; ^ oo. Since {x'^} C Q, there is a sequence 
{t''} C [0, 1] such that 



nix^t^) 



( t''x\ + {l-t''){x''YAix^ \ 

t^xl^ + {l-t^){x^YA^x^ 
\ t'^xi + (1 - t''){{x^Yx^ -I) ) 



0. 



(8) 



Since x^ ^ 0, it follows from (8) that ^ 1. By assumption, there is no solution to the equation 
^{x) = 0, so it follows from (8) that 7^ 0. As a result, (8) can be written as 



By the definition of we have 



1 -i*^ 



x^, t'=G(0,l), k>l. 



{x'fAx' = - 



{x'^fx'' 



l,...,m, 



x^ 



where tk G (0, 1) for all A; > 1. The desired result then follows by setting 7*^ — 



□ 
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A similar analysis to the above (by degree theory) has been used in the existence analysis for 
the solution of finite-dimensional variational inequalities and complementarity problems (see e.g. 
[28, 51, 52, 53]). It is also worth mentioning that the identity mapping in T-L{x,t) can be replaced 
by a general invertible mapping (p{x) with \deg{(p, D,0)\ ^ 0, and thus the result developed in 
this paper can be easily adapted to this case. However, we choose to use the identity mapping 
throughout this paper in order to keep results as simple as possible. 

Prom Lemma 2.3, we can prove the next result. 

Lemma 2.4. //$(a;) = has no solution, where $ is defined by (5), then there exists a vector 
X with \\x\\ = 1 such that 

x'^AiX = -^Xi, i = l,...,m, -Xn = S e (0,1), (9) 



and hence 



(^E -^i^ij 2 = ^(1 - 5^) > 0. (10) 



Proof. Suppose that $(x) = has no solution. Then, by Lemma 2.3, there exists a sequence 
{x^} satisfying (6) and (7), and Ijx'^ll oo as k — )• oo. We see from (7) that x!^ < for 
all sufficiently large k. It is not difficult to show that any accumulation point of the sequence 
|a;^j/||x'^||| is in (—1,0). In fact, since .xj^ is negative for all sufficiently large k, any accumulation 

point of the sequence |a;^/||x'^||| must be in [—1,0]. So it is sufficient to prove that it is not equal 
to —1 or 0. Let x be an arbitrary accumulation point of the sequence |x^/||,'c'^|| |. By passing to 
a subsequence if necessary, we may assume that lim^_^Q<-, 

^fc^||^fc|| _ gy ^j^^ have 

(11) 




and, by (6), for every i = 1, . . . , m, we have 




x^AiX. (12) 



Case 1: Assume that .x„ = —1. Then, from (11), we see that 7^/||x^|| — )■ 1. Since x„ = — 1 
and ||x|| = 1, we must have rc^'/ Hx'^H — >■ = for all i = 1, . . . , m. Thus, it follows from (6) that 

x^AiX = —Xi = 0, i = 1, . . . ,m. 

This implies that the unit vector x is a solution of the system (2), i.e., $(£) = 0, contradicting 
the assumption of this lemma. 

Case 2: Assume that x„ = 0. Then it follows from (11) that T^/Ux'^H — )■ oo as /c — )■ oo. Thus, 
from (12) we have x^/Ux'^H = 0, i = 1, . . . , m. This contradicts the fact that ||x|| = 1. 

Both cases above yield a contradiction. Thus we conclude that for any accumulation point x of 
{x'^/llx'^ll}, its last component ,t,„ satisfies x„ G (—1,0). We now show that such an accumulation 
point satisfies (9) and (10). Indeed, without loss of generality, we assume that limj,_^oo x'^/ljx*^!! = 
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X and —Xn = 5 G (0, 1). From (11), we see that 7^/11x^^11 — )• 1/6, and thus (9) fohows directly from 
(12). Multiplying (6) by xf^ for each i and adding them up yield 

(TO \ m 

Y^X^AA x' = -7^E(-')' = (ll-'f - i-n?) ■ 

i=l J i=l 

Dividing this equality by Hx'^p and taking the limit yield (10). □ 

An immediate consequence of Lemmas 2.1 and 2.4 is the following sufficient condition. 
Corollary 2.5. // the system 

x^AiX = — , i = 1, . . . ,m, x„ G (— 1, 0), ||x|| = 1 

is inconsistent, then the system (1) has a rank-one solution. 
Based on this fact, we have the following result. 
Theorem 2.6. If Ai,i = 1, . . . ,m, satisfy the condition 

max Xi{x^ Aix) > for all x with \\x\\ = 1 and Xn < 0, (13) 

l<i<m, x'^AiX^O 

then the system (1) has a rank-one solution. 

Proof. We prove this result by contradiction. Assume that the system (1) has no rank-one 
solution. Then, by Lemma 2.1, the equation $(x) = has no solution. It follows from Lemma 
2.4 that there exists a unit vector x satisfying (9). Multiplying both sides of (9) by Xj yields 

Xi{x^ Aix) = -\xl , i = l,...,m, -x„ = 5g(0, 1). 



Note that ||x|| = 1 and |x„| = 6 < 1. Thus (xi, . . . , Xm) 7^ 0, which implies that 

max ^ Xi{x'^Aix) = max^ {—xf/S) < 0. 

l<i<m, x^AiX^O l<i<m, Xi^O 

This contradicts (13). □ 

Corollary 2.7. If Ai,i = 1, . . . ,m, satisfy the condition 

max Xi{x^ Aix) > for all x / 0, (14) 

l<i<m, x'^AiX^O 

then the system (1) has a rank-one solution. 

Clearly, the condition (14) is stronger than (13). So it implies the existence of a rank-one 
solution to the system (1). Motivated by conditions (13) and (14), we introduce the class of P0 
functions defined as follows. 

Definition 2.8. Let D C and x e D. A mapping F : ^ R"' is said to be a Pijj-function 
at X over D if 

max (xj — Xi)(Fi(x) — -Fj(x)) > for all x & D, x x. 

l<i<n, Fiix)^Fiixy 
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Recall that for a given set D C and x & D, the mapping G : i?" — )• i?" is said to be a 
Po-function at x over D if max-^^^^^ ^ (^i ~ Xi){Gi{x) — > for all x 7^ x and x E D. 

The class of Po-functions has been widely used in nonlinear analysis and optimization (see e.g. 
[16, 24, 52, 53]). There are some relationships between Pg-functions and Pg-functions. In fact, 
when the inverse of a Pg-function exists, it is easy to see that the inverse is a Po-function. By 
Definition 2.8, we can state the following result. 

Theorem 2.9. Let T : ^ be defined by 



X X X 



and let U = {x : \\x\\ < 1}. If T is a P^-function at x = over U, then the system (1) has a 
rank- one solution. 

Proof. Since T is a P0-function at a: = over U, we have for any x e U \ {0} that 

max Xii^iix) - Ti(0)) > 0. (15) 

In particular, for any x such that ||a;|| = 1 and x„ < 0, we have Xn{^n{x) — ^n{^)) = XnX^x = 
Xn < 0. So (15) is reduced to 

max XiipF Aix) > 0. 

l<i<m, x'^AiXj^O 

By Theorem 2.6 or its corollary, the system (1) must have a rank-one solution. □ 

Remark 2.10. In this section, we have seen that the degree-based analysis can provide a 
sufficient condition for the system (1) to have a rank-one solution. In section 5, we will further 
show that such a sufficient condition is almost necessary for the system (1) to have a rank-one 
solution. In section 3, we show that checking whether or not the system (1) has a rank-one 
solution is equivalent to solving an SDP problem with a rank constraint, which is clearly not 
an easy problem due to the rank constraint. It is well known that a general rank minimization 
problem are NP-hard [43, 50] since it includes the so-called cardinality minimization problem as 
a special case. So roughly speaking, the level of difficulty for checking the conditions developed in 
this paper, such as the ones in Corollary 2.5, Theorem 2.6 and Theorem 4.5, are almost equivalent 
to that of the original system (1) which, except for the case of m = 2 and n > 3, is difficult in 
general. However, these conditions provide a new angle (from degree theory) to understand the 
system (1). More interestingly, some verifiable sufficient conditions (from a rank optimization 
point of view) can be also developed for the system (1) to have a rank-one solution, as shown in 
the next section. 



3 Existence of a rank-one solution: rank optimization 

We now study the existence of a rank-one solution to the system (1) from a rank optimization 
point of view. When m = 2 and n > 3, Theorem 1.1 claims that the condition ti -|-t2^2 ^ is a 
complete characterization of the existence of a rank-one solution to the system (1). However, this 
result does not hold when m > 3. It is interesting to note that a complex counterpart of such a 
result was given in [41]. In this section, we show that some conditions stronger than 1 tiAi / 
are needed in order to ensure the existence of rank-one solutions. Before we proceed, let us first 
reformulate the problem as a rank constrained optimization problem. 
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Consider the following rank-constrained optimization problem: 

max{(/, X) : (A, ^) = 0, i = l,...,m, rank(X) < 1, X ^ 0}. (16) 

If X = is the only feasible point to the problem, then the optimal value of the problem is 0. 

Otherwise, it is oo. Since the system (1) is homogeneous, normalizing the system docs not change 
its solvability and the rank of its solutions. So adding the constraint ti{X) < 1 (i.e., {I,X) < 1) 
to (16) yields the following problem: 

z* = max (/, X) 

s.t. {Ai,X) = 0, i = l,...,m, 

rank(X) < 1, (17) 
tr{X) < 1, 

xto. 

Since the optimal value z* is either or 1, we have the following observation. 

Lemma 3.1. The system (1) has a rank-one solution if and only if z* = 1 is the optimal 
value of (17). 

In other words, z* = is the optimal value of (17) if and only if (1) has no rank-one solu- 
tion. Lemma 3.1 indicates that checking the existence of a rank-one solution to the system (1) 
is equivalent to solving an SDP problem with the rank constraint rank(X) < 1, which is hard to 

solve in general because of the discontinuity and nonconvexity of rank(X). Based on the problem 
obtained by dropping the constraint "rank(X) < 1" from (17), we have the following result. 

Lemma 3.2. There exist ti e R,i = 1, . . . ,m, such that U^i i/ and only if X = 

is the only solution to the system (1). In other words, YllLi tiAi )f for all ti £ R,i = 1, . . . ,m, 
if and only if the system (1) has a nontrivial solution, i.e., a solution X with rank(X) > 1. 

Proof. The standard SDP duality theory [49] (or the result in [7]) can yield the result of this 
lemma. In fact, let us consider the SDP problem 

max{(I, X) : {Ai, X) = 0, z = 1, . . . , m, tr(X) < 1, X ^ 0}, (18) 

and its dual problem 

minja: ^tj^j -|- al ^ /, a > 0, G = 1, . . . ,m| . (19) 

Clearly, (19) satisfies the Slater's condition (for instance, (a, ti, . . . , tm) = (2, 0, . . . , 0) is a strictly 
feasible point). The optimal value of (19) is obviously finite. By the duality theory of semidefinite 
programming, both problems (22) and (19) have finite optimal values and there is no duality 
gap between them (i.e., their optimal values are equal). If there exist ti,i = 1, . . . ,m such that 
X^ilLi tiAi >- 0, then Y^^iW'ti)^i t I for some /3 > 0, which means that the optimal value of the 
dual problem (19) is 0. Thus the optimal value of (22) is also 0, implying that X = is the only 
point satisfying the system (1). Conversely, if X = is the only solution of (1), then the optimal 
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value of (22) is 0, and thus the dual optimal value is also 0, i.e., a* = 0. This indicates that there 
exist ti e R,i = 1,. . . ,m, such that J2iLi UA h I y 0. □ 

As we mentioned in section 1, the result of Theorem 1.1 does not hold for m > 3. That is, 

only knowing that the system (1) has no rank-one solution does not give a full picture of the 
condition J^iLi UAi >- 0. The system (1) may have no rank-one solution, but have a solution with 
rank(X) > 2. For example, let 







Ao 



-1 



-1 
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(20) 



It is easy to see that for this example there is no x 7^ satisfying AiX = 0, i = 1, 2, 3, and hence 
the corresponding system (1) has no rank-one solution. However, the system has a higher rank 
solution, X = diag(l, 1, 1, 0). Clearly, there exists no (ti, ^2, H) such that tiAi + 12^2 + ^3^3 >- 
for this example. To ensure the condition X^I^i U-^i 0, Lemma 3.2 claims that the system 
(1) must possess not only no rank-one solution but also no solution with rank higher than 1. It 
should be stressed that the condition Y^^i UA / for all ij's implies that there is a nonzero 
solution X to the system (1), but it cannot ensure that rank(X) = 1. Some stronger conditions 
than X^i^i ^i^i ^ should be imposed in order to guarantee the existence of a rank-one solution. 

From Lemma 3.2, we see that the linear combination of ^j's plays an important role in 
determining the solution structure of the system (1). Given a finite number of matrices Ai,i = 
l,...,m, we use r* to denote the maximum rank of the linear combination J2iLitiA, where 
ti E R,i = 1, . . . ,m are chosen such that the linear combination is positive semidefinite, i.e.. 



r* = max < rank ^ t^Ai : ^ tiAi ^0, ti E R, i = 1, . . . , 



m 



(21) 



vi=l 



i=l 



Clearly, r* is finite and attainable. Moreover, r* = n is equivalent to Y^^i U-^i >~ 0. The next 
result shows how r* affects the existence of a nontrivial solution to the system (1), including 
low-rank ones. It also indicates when the rank-constrained problem (17) can be reduced to an 
SDP problem. 



Corollary 3.3. (i) The system (1) has a solution X ^ Q if and only if r* <n — 1, where r* 
is defined by (21). Moreover, any nonzero solution X of (1) satisfies rank(X) < n — r*. 

(ii) Particularly, if r* = n — 1, then the system (1) has a rank-one solution, and the rank-one 
solutions are the only nonzero solutions of (1). In this case, the problem (17) is equivalent to the 
SDP problem 

max{(7, X) : {Ai, X) = 0, i = l,...,m, tr(X) < 1, X ^ 0}. (22) 



Proof. (i) Lemma 3.2 claims that r* = n if and only if X = is the only solution of (1). 
Thus, the system (1) has a nonzero solution if and only if r* < n — 1. It is sufficient to prove that 
any nonzero solution X of (1) must satisfy rank(X) < n — r*. Indeed, let (f^, . . . ,t1^) determine 
the maximum value r*, i.e., 

(m \ m 

i=l ) i=\ 
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Let X be an arbitrary solution of (1). Thus, X satisfies 

I m \ m 

ix, ^t*AA=Y,tUx, Ai) = 0, xto. 

\ i=l I i=l 

Since X ^ and J^^i *i t 0, it implies that 

Thus, rank(X) < n - rank (YliLi t*iA) = n-r*. 

We now prove (ii). Suppose r* = n — 1. Then the first half follows directly from (i) and Lemma 
3.2. Moreover, since any solution of (1) satisfies rank(X) < n — r* , it must satisfy rank(X) < 1. 
This means that the rank constraint in (17) is redundant. As a result, the problem (17) is reduced 
to the SDP problem (22). □ 

From Lemma 3.2 and Corollary 3.3, the cases r* = n and r* = n— 1 are clear. In the remainder 
of this section, we focus on the case r* < n — 2 for which certain conditions should be imposed 
in order to ensure the existence of a rank-one solution. In fact, when r* < n — 2, the system (1) 
may have a solution with rank(X) > 2, but no rank-one solution. It is easy to see that r* < n — 2 

holds in the example (20), since r* = 0. Another simple example is that ^41 = ^^ ^ and 

^2 = ^ ^ ) ' ^^^^^ example, wc have r* = n — 2, but the system {Ai,X) = 0, {A2, X) = 0, 

X ^ has no rank-one solution. We now state an existence condition for the case r* < n — 2. 

Theorem 3.4. Suppose that r* < n — 2. Then the system (1) has a rank-one solution if any 
of the following conditions holds: 

(i) For each i, Ai is either positive semidefinite or negative semidefinite. 

(ii) There exists exactly one indefinite matrix among Ai 's. 

(iii) There are more than one indefinite matrices among A^ 's, and there is an indefinite matrix 
Ak such that 

{x : x^AkX = 0} C Pi {x: x^ Aix = 0}. (23) 

All indefinite A;, i^A; 

Proof. When r* < n—2, by Lemma 3.2 the system (1) has a solution with 1 < rank(X) < n—r*. 

So if the system has no solution with rank (X) > 1, then it must have a rank-one solution. Thus, 
without loss of generality, we assume that the system (1) has a solution X* with rank(X*) = r > 2, 
and hence X* can be decomposed as 

X* = \iu\u^f + ■■■ + \rU''{u'f, 

where \j > and ,j = 1 , . . . , r are eigenvalues and eigenvectors of X* , respectively, and 's 
are mutually orthogonal. For every i = 1, . . . , m, we have 

Q = {Ai,x*) = f2Hy''fAu^. 

In particular, if ^ or A^ :< 0, then the above equality implies 

{u^fAiU^ = for all j = 1, . . . , r. (24) 
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First we suppose that condition (i) holds. That is, either ylj ^ or ylj ^ holds for each 
i. Then (24) implies that any of the matrices u^ivP)'^ ,j = 1, . . . ,r is a rank-one solution to the 
system (1). This shows that condition (i) ensures the existence of a rank-one solution. 

Next, we suppose that condition (ii) holds and let Aj. be the only indefinite matrix. If 
{u^)'^AkU^ = for some j, then X = u^[u^)^ readily gives a rank-one solution to the system 
(1), since (24) holds for all i ^ k. On the other hand, if {u^)'^ A^u^ ^ for all j = 1, . . . ,r, then 
from the fact that \j > for all j and 

r 

= {Ak,X*) = J2^j{y''fAkU^, 
i=i 

it follows that there exist two indices p and q such that 

({uPfAkuP) ({u'lfAku'i) < 0. 

By continuity, there exists a 7 G (0, 1) such that 

w = ^uP + {l-j)u'', w'^AkW = 0. (25) 

Since vP and are orthogonal, it is evident that w ^ 0. U Ai y or Ai ^ 0, then (24) implies 
that AiU^ = for all j = 1, . . . , r. Thus we have 

w'^AiW = -f\uPfAiuP + (1 - ^fiu'ifAiu' + 27(1 - -f){uPfAiu'i = (26) 

for all i ^ k. Therefore, X = ump- is a rank-one solution of (1). Consequently, condition (ii) 
ensures the existence of a rank-one solution. 

Finally, we suppose that condition (iii) holds. If {u^y A^u^ = for some j, then it follows from 
(23) that {u^)'^Aiu^ = for all other indefinite matrices Ai. Since (24) holds for all matrices Ai such 
that Ai ^ or ^ 0, we may deduce that X = vP{u^ )'^ is a rank-one solution of the system (1). If 
{u^)^AkU^ / for all j = 1, . . . , r, then by the same reasoning as above, we can find a vector w 
that satisfies (25). We can also repeat the same argument as above to show that w satisfies (26) 
for all Ai>z or Ai :< 0. Moreover, by (23), we have w'^Aiw = for all indefinite Ai with I ^ k. 
Thus, the nonzero vector w satisfies w'^AiW = for alH = 1, . . . , m, implying that X = wuF is 
a rank-one solution to the system (1). The proof is complete. □ 

Remark 3.5. Given a set of matrices Ai,i = l,...,m, conditions (i) and (ii) in Theorem 
3.4 can be verified straightaway. A simple (and trivial) example satisfying the condition (iii) 

/ 1 

of Theorem 3.4 is as follows: Consider the system (1) with m = 3 and Ai = 1 

\ -1 
/ \ 

A2 = 2Ai and A3 = 3Ai. Then the condition (23) holds trivially, and X = 1 1 is a 

V 1 1 y 

rank-one solution of the system (1). 

Remark 3.6. Theorem 3.4 shows that the number of indefinite matrices among AiS and their 
relationships are closely related to the existence of a rank-one solution to the system (1). While 
this result gives some sufficient conditions for the system (1) to have a rank-one solution, it is 
worth noting that these conditions remain not tight, as shown by the following example: Consider 
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1 


• 


and A2 ^ 


V 


-1 


• 


V 









\ 








which are both indefinite. It 

Voo-iy Vooiy 

is easy to see that 

{x : x^Aix = 0} g {x : x'^A2X = 0}, {x : x^A2X = 0} % {x : x^ Aix = 0}. 

So all conditions (i), (ii) and (iii) in Theorem 3.4 do not hold for this example. However, the 

,000 

system (1) with these two matrices has a rank-one solution, for instance X 



1 1 
1 1 



IS a 



rank-one solution. 



From Corollary 3.3(i), the rank of the solution of (1) is at most n — r*, which is a uniform 
bound for all solutions. From a practical viewpoint, it is important to compute the value r* . This 
motivates us to study the rank maximization problem (21), which can be rewritten as 



r* = max |a : rank |^^ii-4ij > A, ^tjA ^ o| . 



(27) 



Since rank(X) is a discontinuous function (in fact, a lower semi-continuous function) of X, the 
set {X : rank(X) > A} is not closed in general. This makes the problem (27) (or (21)) difficult 
to solve directly. In what follows, we propose a method to estimate r* from below. The following 
lemma will be used in our analysis. 

Lemma 3.7. [25, 26, 43] The convex envelope o/rank(X) on the set {X G i?'"''" : ||X|| < 1} 
is the nuclear norm ||X||*. 

Note that for any matrix y 7^ 0, we have rank(F) = rank(ay) for any a 7^ 0. Thus problem 
(17) can be rewritten as 



max 



{/ m \ m m '\ 

rank Mi : ^^Mi^O, Y^^iAi < l\ . 
\i=l ) i=\ i=l J 



(28) 



Since -< Y^l^^^tiA^ ■< I, we have || Z^^^i ij^iH < 1- By Lemma 3.7, we conclude that in the 
feasible region of the problem (28), the nuclear norm of Y^iLiU^i is the convex envelop of the 
objective function of (28). As a result, we have 



rank ( ^ tiAi ) > 



vi=l 



^ ^ tiAj 



i=l 



(29) 



for any (ii, . . . ,tm) satisfying ^ Y^iLi tiAi ^ /. By the positive semidefiniteness of U^i, 
we have 



i=l 



ti ij^tiA] =X^iitr(A 



Ki=l 



1=1 



Thus, we may consider the following problem: 

( m rn m ^ 

?7* =maxi^t^tr(A) : J^^i^^^^ l^Mi^^L 



(30) 



i=l 
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which is an SDP problem with a finite optimal value ij* < n. By (29) and Lemma 3.7, the optimal 
objective value of (30) provides a lower bound for that of (28), i.e., r* > \r]*]. The dual of (30) is 
given by 

min{(/,X) : {Ai,X) - {Ai,Y) =tr{Ai), i = l,...,m, X^O, YhO}. (31) 

This problem is strictly feasible and has a finite optimal value. For instance, {X, Y) = (21, 1) is a 
strictly feasible point. By the duality theory, there is no duality gap between (30) and (31), and 
hence we may solve either of them to get the optimal value rf*. An immediate consequence of the 
above analysis is the following result. 

Theorem 3.8. Let r* be the maximum rank defined by (21), and let rj* be the optimal value 
of the SDP problem (30) or (31). When r* < n — 2, every nonzero solution X of the system (1) 
satisfies rank(X) < n — [77*] . 

This result provides an upper bound for the rank of nonzero solutions of (1), and the bound 
n — [?7*] can efficiently be obtained by solving (30) or (31). 

Remark 3.9. Consider the problem of finding X G S" that satisfies 

{Ai,X) = bj, j = l,...,m, X to. 
If the above system has a solution, then it has a solution X such that 



rank(X) < 



^/8m+T-l 



(32) 



which is called Barvinok-Pataki's bound [4, 40]. For a homogeneous system (i.e., bj = 0,j = 
1, . . . ,m), a solution satisfying the bound (32) can be only the trivial solution X = 0, and any 
nontrivial solution may not satisfy this bound. In other words, the Barvinok-Pataki's bound is 
not necessarily valid for nontrivial solutions of a homogeneous system. For example, let Ai = 

^0 ^1 ^ ~ ^ 1 ^ ' '^^^ right-hand side of (32) is equal to 1 (since m = 2). However, 

as we mentioned earlier, all nontrivial solutions to the system {Ai,X) = 0, (^2,-^) = 0, X y 
have rank 2. Thus, Barvinok-Pataki's bound (32) cannot directly apply to nontrivial low-rank 
solutions of a homogeneous system like (1). In order to apply this bound to the homogenous 
system (1), we may introduce an extra equation, for instance, {I,X) = 1, and consider the 
following system: 

{A,x) = o, j = i,...,m, {i,x) = i, xyo. (33) 

Note that rank(tX) = rank(X) for any t ^ 0. By the homogeneity of (1), we see that any nonzero 
solution (if exists) of (1) can be scaled so that it satisfies (33). Thus, if the system (1) has a 
nonzero solution, then the minimum rank of nonzero solutions of (1) and (33) are the same. 
Therefore, applying (32) to (33), we can conclude from Theorem 3.6 that when r* < n — 2, the 
system (1) has a solution X ^ satisfying 



1 < rank(X) < minj^n — r*, 
< min < n — \r]*~\ , 



V^8(m + 1) + 1-1 



V'8(m + 1) + 1 - 1 
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So when r* is relatively large, e.g., n — 2, n — 3, and so on, the rank of a nontrivial solution to 
(1) will be low. In such cases, Barvinok-Pataki's bound might be too loose (especially when m 
is relatively large). The upper bound given by n — r* or even n — [r/*] for the rank of nonzero 
solutions can be much tighter than Barvinok-Pataki's bound in these situations. 



4 Conditions for (1) to have no rank-one solution 

The following necessary condition for the system (1) to have no rank-one solution has actually 
been shown in section 2 (see Lemmas 2.1 and 2.4, or Corollary 2.5). 

Corollary 4.1. When m < n — 1, if the system (1) does not have a rank-one solution, then 
there exists a vector x such that 

x^ AiX = — , i = 1, . . . ,m, \\x\\ = 1, Xn & (—1, 0). 

Although the condition Y^iLiU-Ai ensures that the system (1) has no rank-one solution, 
this sufficient condition is too restrictive. In fact, by Lemma 3.2, it implies that the system (1) 
cannot have any solution with rank(X) > 1. The purpose of this section is to show that another 
sufficient condition for the system (1) to have no rank-one solution can be developed from a 
homotopy invariance point of view. Note that the following three statements are equivalent: (i) 
The system (1) has no rank-one solution; (ii) x = is the only solution to the system (2); and 
(iii) 

max Ix^^jxl > for any a; 7^ 0. (34) 

l<i<m 

First, we formulate these equivalent statements as a nonlinear equation. 

Lemma 4.2. x = Q is the only solution to the system (2) if and only if there exists a constant 
P > such that for any /x G (0,/3], we have 

{x : \\x\\ = l} = {x: G^{x) = 0}, 

where : BP" — >■ is defined by 



\x'^Aix\ — H — A 



G,{x)=[ — - - V------' 1, (35) 

\ X X — 1 ) 

i.e., the set {x : ||a;|| = 1} coincides with the solution set of the equation G^{x) = for any 
/xG (0,/3]. 

Proof. Assume that x = is the only solution of the system (2). Thus, by (34), we have 
Y^^i Aix\ > for any x such that x'^x = 1. By continuity, there exists a positive number 
^ > (for instance, we can take P = mm^Yn^i \x'^Aix\ : ||x|| = l| which is positive) such that 

m 

\x'^Aix\ > A* (36) 

i=l 

holds for any x with x'^x = 1 and for any /x G (0,/3]. Note that any inequality h{x) > can be 
represented as the equation \h{x) \ — h{x) = 0. So (36) can be rewritten as 



|x"^74jx| — n — { ^ |x"^74jx| — A* = 0- 



i=l \i=l 
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This implies that any x satisfying x x = 1 is a solution to the equation 

G^{x) = 

for any G (0,^]. Thus, the set {x : \\x\\ = 1} is contained in the solution set of G^{x) = for 
any ^ G (0, (3]. Since G^{x) = implies ||a;|| = 1, the set {x : \\x\\ = 1} is exactly the solution set 
of G^{x) = for any given /U G (0, /3]. 

Conversely, let us assume that there exists a positive number /3 > such that for any given 
constant jj, G (0,/3], the solution set of the equation Gn{x) = is equal to the set {x : ||x|| = 1}. 
We now prove that x = is the only solution of (2). Assume the contrary that the system (2) has a 
solution X 7^ 0. Then, x = x/||x|| is also a solution of the system (2), i.e., xF AiX = 0, f = 1, . . . , m. 
By assumption, any unit vector is a solution to G^{x) = for any given G (0,/3]. Thus, we have 

m 

^ |x"^Aix| — /X 

i=l 

Since xF A^x = for alH = 1, . . . , m, the above equality reduces to 

= 2//, 

which is a contradiction since /x G (0,/3]. □ 

We assume m < ra — 2 in the remainder of this section. Again, by using Lemma 2.2, we have 
the following technical result. 

Lemma 4.3. Assume that m < n — 2. Let n > be a given constant and G^ he defined by 
(35). If G^{x*) / for some x* with ||x*|| = 1, then there exists a sequence {x^} satisfying the 
following conditions: \\x^\\ — >■ oo as k oo and 

(x'^f Aix'^ - (x*f Aix* = —f'^x^ (37) 

(x^f ^^x^ - (x*)^^^x* = -j'^xi, (38) 

m 

^KxT^.x'^l-/^ 

i=l 

{x^ - x*f{x^ - X*) = —1^x1, (40) 

where G (0, oo) for all k. 

Proof. If m < n — 2, we may set Am+i = 0, . . . , An-2 = 0, and consider the systems (1) and 
(2) with Ai,i = 1, . . . , m (= n — 2). Thus, without loss of generality, we assume m = n — 2. Since 

G^(x*) / and ||x*|| = 1, we have 

m 

53l(x*)^Ax*|-/x 

1=1 



I ^ ■ If I 



= 0. 



-^KxT^x^l 



1) 



(39) 



16 



Thus the fohowing equation has no solution: 

/ x^Aix - {x*YAix* 



V 



{x — x*Y(x — X*) 



0. 



(41) 



Consider the homotopy between the identity mapping and 0^(x), i.e., 

H^{x,t) = tx + {\-t)Q^{x), 

and let 

% = {xeR'' : H^{x, t) = for some t G [0, 1]}. 

A similar proof to that of Lemma 2.3 can be used to show that 7^ is unbounded. Here we 

include the proof for completeness. Assume to the contrary that 7^ is bounded. Then there 
exists an open bounded ball D that is large enough to satisfy C D and dD P| 7^ = 0. Thus 
^ {H^{x,t) : X e dD, < t < 1}, which implies that deg{I,D,0) and deg(6^,Z',0) are well 
defined. By Lemma 2.2, we have 

dcg(e^,i?,o) = dcg(/,i?,o) /o, 

which means that the equation Q^{x) = has a solution. This is a contradiction. Thus the set 
Tn is indeed unbounded, and hence there is an unbounded sequence {x^} in 7^. Without loss of 
generality, let x^ ^ for all k. By the definition of 7^, there is a sequence {t''} C [0, 1] such that 
H^{x\t'') = 0, i.e.. 



t'^x'f + (1 - t'')[{x^ fAix'' - {x* fAix*] = 



t^xl, + (1 - t^)[{x''Y A^x'' - {x* fA^x*\ = 0, 



t^xi_^ + {i-e) 



Y^\{x^fA,x^\-^, 



i=l 



Y,\{x''fA,x^\+yi 



i=l 



exi + (1 - e){x'' - xy {x^ - x*) = o. 

Since Hx'^H — )■ cx) as — )■ oo and 0^(.t'^') / for all /c > 1, we see that ^ 1 and for all 
k > 1. Thus, G (0, 1) for all A; > 1. By setting 7^ = G (0, 00), the above system can be 
rewritten as 



= -j'^x^, k>l, 



which along with the definition of 0^ implies that 

{x'')'^Aix'' - {x*)'^Aix* = -j'^Xi, 



(x ) AyfiX (x ) AffiX — 7 Xjj^, 
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m 
i=l 

{x^ - x*f{x^ - X*) = —i^xl, 

as desired. □ 

Based on Lemma 4.3, we can prove the following result. 

Lemma 4.4. Let m < n — 2 and fi > be a given constant. If G^{x*) ^ for some x* with 
\\x*\\ = 1, then there exists a vector x satisfying the following conditions: 

J-^AjX = z = 1, . . . ,m, = x„ G [— 1,0), ||x|| = 1. (42) 

Proof. Without loss of generahty, we still assume that m = n — 2. Let {x^} be the sequence 
specified in Lemma 4.3. Since the left-hand sides of (39) and (40) are nonnegative, we see that 

< for all A; > 1. Let x be an accumulation point of x'^/||a:;'^||. By dividing (37)-(40) by \\x^\\^ 
and passing to a subsequence if iiecGSSB^ry, wg Ccin prove thcit — )■ Xn 7^ 0. In fact, if x„ = 0, 
(40) implies 7'^/||.x'^|| — > co. Then it follows from (37)-(39) that x-i = for all i = 1, . . . , n — 1. 
This contradicts the fact ||x|| = 1. Therefore, we conclude that x„ G [—1,0). It then follows from 
(40) that ^ 7 G (0,00), where 7 = — 1/2„. Normalizing the system (37)-(40) by \\x'^\\^ 

and letting A; — >■ 00 yield 

x^AiX = -^Xi, i = l,...,m, = -7Xn-i, 1 = -7^n, x„ G [-1, 0). 

Eliminating 7 from the above system yields the desired result. □ 

Basically, the next result shows that what an extra condition can make the necessary condition 
in Corollary 4.1 sufficient. 

Theorem 4.5. Let m < n — 2 and Ai e i = 1, . . . ,m. Suppose that = (0, . . . , 0, 1)-^ G 
i?" is not a solution of the system (2), and suppose that there is a vector x satisfying the following 
condition: 

x'^AiX = — , i = 1, . . . ,m, x„ G (—1, 0), ||x|| = 1. (43) 

If Xn-1 ^ for any x satisfying (43), then x = is the only solution to the system (2), i.e., the 
system (1) has no rank-one solution. 

Proof. Under the condition of this theorem, we prove that there is a /3 > such that 

{x : \\x\\ = 1} = {x : Gf^{x) = 0} for any fi G (0,/3], 

where is defined by (35), and thus by Lemma 4.2, x = is the only solution to the system (2). 
We prove this by contradiction. Assume that such a /3 does not exist, i.e., for any given /3 > (no 
matter how small it is), there always exists a /it G (0, j3] such that {x : ||x|| = 1} 7^ {x : G^i{x) = 0}. 
In other words, there exists an x* with ||x*|| = 1 such that G^{x*) 7^ 0. Then, by Lemma 4.4, 
we conclude that there exists an x satisfying (42). Since e„ = (0, ...,0, 1)"^ G R"' is not a solution 
of the system (2), we deduce that x„ 7^ —1 in (42), and hence x satisfies (43) and Xn-i = 0, 
contradicting the assumption of the theorem. □ 



\{x''fAx''\-l^\ = 
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Remark 4.6. The above theorem provides a sufficient condition for the system (1) to have no 
rank-one solution. This is equivalent to saying that when the system (1) has a rank-one solution, 
such a sufficient condition must fail. For example, let us consider the following system: 



At 



-1 



A, 



-1 



-1 



-1 



10 

1 






(44) 



For this example, 65 is not a solution of the system (1), and the condition (43) can be written as 



x^{x\ - xl) = Xi 
x^{xl~xl-xl-xl) = 

Xr^{xiX2) = X3 

0:5 G (-1,0), ||x|| = 1. 



X2 



If we set a;4 = 0, then the above condition imply that xi = x^^ = 0, X2 — —-^^ 
Therefore, the point x = (0, — 1^,0, 0, i)"^ satisfies the above condition with 



— and X2 + x\ 



1. 




/3\ 1/2 



G(-1,0). 



So for this example the sufficient condition in Theorem 4.5 does not hold, and it is easy to see 
that the system (1) with matrices given by (44) has a rank-one solution, for instance, X = xx^ 
where x = (0,1,0,0,0)^. 

Remark 4.7. From the analysis in this paper, the condition (43) is intrinsically hidden 
behind the condition "there is no rank-one solution to the system (1)", or equivalcntly, ".x = 
is the only solution to the system (2)". Theorem 4.5 shows that this type of necessary condition 
together with some other conditions can be sufficient for the nonexistence of a rank-one solution 
to the system (1). However, the relationship between the new sufficient conditions in this paper 
and the known condition "5^1™ 1 tiAi y 0" is not clear at present. These two types of conditions 
seem independent to each other. Corollary 3.3 and Theorem 3.4 indicate that only a small gap 
exists between the existence and nonexistence of a rank-one solution to the system (1). If r* = n, 
then X = is the only solution of the system (1). However, a small perturbation of the system 
such that r* = n — 1 will guarantee the existence of a rank-one solution to the system. Thus, 
the development of a new sufficient condition weaker than J27=i ^i^i ^ becomes subtle, and 
there might be no easy and simple way to state such a sufficient condition. As we have shown 
in section 3, checking whether or not the system (1) has a rank-one solution is equivalent to 
solving an SDP problem with rank constraints which is a difficult problem. This indicates that 
the conditions developed in sections 2 and 4 of this paper are not easy to check directly. However, 
these conditions make it possible for us to understand the problem from the nonlinear analysis 
perspective. 



5 Conclusion 

Some sufficient and/or necessary conditions for the existence of a rank-one solution to the system 
of HLME over the positive semidefinite cone have been developed. These conditions have been 
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derived from two different perspectives: degree theory and rank optimization. The result out 
of the former shows that the P0 property of the function defined by quadratic transformations 
can ensure the existence of a rank-one solution (e.g., Theorems 2.6 and 2.9). Prom the latter, 
it turns out that the maximum rank r*, defined by (21), plays a key role in the existence of a 
rank-one solution. For instance, r* = n — 1 can ensure the system of HLME has a rank-one 
solution (see Corollary 3.3), and the number of indefinite matrices in the system can be also 
related to the existence of a rank-one solution (see Theorem 3.4). Finally a sufficient condition 
for the nonexistence of a rank-one solution to the system of HLME was also given (see Theorem 
4.5). 



References 

[1] J. Abernethy, F. Bach, T. Evgeniou and J. P. Vert, Low-rank matrix factorization with at- 
tributes, TR N24/06/MM, Ecole des Mines de Paris, 2006. 

[2] B. Ames and S. Vavasis, Nuclear norm minimization for the planted clique and biclique 
problems. Technical report. University of Waterloo, 2009. 

[3] N.S. Aybat and G. Iyengar, A unified approach for minimizing composite norms. Technical 
Report, Columbia University, 2010. 

[4] A. Barvinok, Problems of distance geometry and convex properties of quadratic maps. Dis- 
crete Comput. Geom., 13 (1995), pp. 189-202. 

[5] A. Barvinok, A course in convexity, American Mathematical Society, 2002. 

[6] A. Ben-Tal and A. Nemirovski, Lectures on Modern Convex Optimization: Analysis, Algo- 
rithms, and Engineering Applications, SIAM, 2001. 

[7] J.M. Borwein and H. Wolkowicz, Regularizing the abstract convex program, J. Math. Anal. 
AppL, 83 (1981), pp. 495-530. 

[8] S. Boyd and L. Vandenberghe, Convex Optimization, Cambridge University Press, 2004. 

[9] S. Boyd, L. El Ghaoui, E. Feron and V. Balakrishnan, Linear Matrix Inequalities in System 
and Control Theory, SIAM, Philadelphia, 1994. 

[10] L. Brickman, On the field of values of a matrix, Proc. Amer. Math. Soc, 12 (1991), pp. 61-66. 

[11] E. Calabi, Linear systems of real quadratic forms, Proc. Amer. Math. Soc, 15 (1964), pp. 844- 
846. 

[12] E. Candes and B. Recht, Exact matrix completion via convex optimization. Found. Comput. 
Math., 9 (2009), pp. 717-772. 

[13] E. Candes and T. Tao, The power of convex relaxation: Near-optimal matrix completion, 
IEEE Trans. Inform. Theory, 56 (2010), pp. 2053-2080. 

[14] E. Candes, J. Romberg and T. Tao, Robust uncertainty principles: Exact signal reconstruc- 
tion from highly incomplete frequency information, IEEE Trans. Inform. Theory, 52 (2006), 
pp. 489-509. 



20 



[15] E. Candes, Compressive sampling, in Proceedings of the International Congress of Mathe- 
maticians, Madrid, Spain, 2006. 

[16] R.W. Cottle, J.S. Pang and R.E. Stone, Linear Complementarity Problems, Academic Press, 
1992. 

[17] J. Dattorro, Convex Optimization & Eculidean Distance Geometry, Meboo Publishing, 2009. 

[18] L.L. Dines, On the mapping of quadratic forms. Bull. Amer. Math. Soc., 47 (1941), pp. 494- 
498. 

[19] L.L. Dines, On the mapping of n quadratic forms, Bull. Amer. Math. Soc, 48 (1942), pp. 468- 
471. 

[20] L.L. Dines, On linear combinations of quadratic forms. Bull. Amer. Math. Soc., 49 (1943), pp. 
388-393. 

[21] D. L. Donoho, Compressed sensing, IEEE Trans Inform. Theory, 52 (2006), pp. 1289-1306. 

[22] D. L. Donoho and X. Hu, Uncertainty principle and ideal atomic decomposition, IEEE Trans- 
action on Information Theory, 47 (2001), pp. 2845-2862. 

[23] L. El Ghaoui and P. Cabinet, Rank minimization under LMI constraints: A framework for 
output feedback problems, in Proceedings of the European Control Conference, Groningen, 
The Netherlands, 1993. 

[24] F. Facchinei and J.S. Pang, Finite- Dimensional Variational Inequalities and Complementar- 
ity Problems: I and II, Springer, 2003. 

[25] M. Fazel, Matrix rank minimization with applications, PhD Thesis, Stanford University, 2002. 

[26] M. Fazcl, H. Hindi and S. Boyd, Rank minimization and applications in system theory, in 
Proceedings of the American Control Conference, Vol. 4, 2004, pp. 3273-3278. 

[27] P. Finsler, Uber das Vorkommen definiter und semidefiniter Formen in Scharen quadratischer 
Formen, Comment. Math. Helv., 9 (1937), pp. 188-192. 

[28] G. Isac and Y.B. Zhao, Exceptional family of elements and the sovability of variational 
inequality for unbounded sets in infinite dimensional Hilbert space, J. Math. Anal. Appl., 
246 (2000), pp. 544-556. 

[29] D. Henrion, S. Tarbouriech and M. Sebck, Rank-one LMI approach to simultaneous stabi- 
lization of linear systems. Systems Control Lett., 38 (1999), pp. 79-89. 

[30] J.B. Hiriart-UrrTity, PotpoTirri of conjectures and open questions in nonlinear analysis and 
optimization, SIAM Review, 49 (2007), pp. 255-273. 

[31] J.B. Hiriart-Urruty and M. Torki, Permanently going back and forth between the quadratic 
world and convexity world in optimization, Appl. Math. Optim., 45 (2002), pp. 169-184. 

[32] R.A. Horn and C.R. Johnson, Topics in Matrix Analysis, Cambridge University Press, 1991. 

[33] N.G. Lloyd, Degree Theory, Cambridge University Press, Cambridge, 1978. 



21 



[34] S. Ma, D. Goldfarb and L. Chen, Fixed point and Bregman iterative methods for matrix 
rank minimization, to appear in Math. Programming. 

[35] R. Meka, P. Jain, C. Caramanis and I. Dhillon, Rank minimization via online learning, in 
Proceedings of the 25th International Conference on Machine Learning, Helsinki, Finland, 
2008. 

[36] A. Nemirovski, C. Roos and T. Terlaky, On maximization of quadratic form over intersection 
of ellipsoids with common center. Math Program., 86 (1999), pp. 463-473. 

[37] J. Nocedal and S. Wright, Numerical Optimization, Springer- Verlag, New York, 1999. 

[38] D. O'Regan, Y. Cho and Y.Q. Chen, Topological Degree Theory and Applications, Series in 
Mathematical Analysis and Applciations, Chapman Sz Hall/CRC, 2006. 

[39] J. M. Ortega and W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several 
Variables, Academic Press, New York, 1970. 

[40] G. Pataki, On the rank of extreme matrices in semidefinite programs and the multiplicity of 
optimal eigenvalues. Math. Oper. Res., 23 (1998), pp. 339-358. 

[41] I. Polik and T. Terlaky, A survey of the S-Lemma, SIAM Review, 49 (2007), pp. 371-418. 

[42] B.T. Polyak, Convexity of quadratic transformation and its use in control and optimization, 
J. Optim. Theory AppL, 99 (1998), pp. 553-583. 

[43] B. Recht, M. Fazcl and P.A. Parrilo, Guaranteed minimum-rank solutions of linear matrix 
equations via nuclear norm minimization, SIAM Review, 52 (2010), pp. 471-501. 

[44] A. So and Y. Yc, Theory of semidefinite programming for sensor network localization. Math. 
Programming, 109 (2007), pp. 367-384. 

[45] R. Stern and H. Wolkowicz, Indefinite trust region sTibproblems and nonsymmetric eigenvalue 
perturbations, SIAM J. Optim., 5(1995), pp. 286-313. 

[46] K.-C. Toh and S. Yun, An accelerated proximal gradient algorithm for nuclear norm regu- 
larized least squares problems, Technical Report, University of Singapore, 2009. 

[47] M.W. Trosct, Distance matrix completion by numerical optimization, Comput. Optim. AppL, 
17 (2000), pp. 11-22. 

[48] F. Uhlig, A recurring theorem about pairs of quadratic forms and extensions: A survey. 

Linear Algebra AppL, 25 (1979), pp. 219-237. 

[49] H. Wolkowicz, R. Saigal and L. Vandcnbcrghc, Handbook of Semidefinite Programming: The- 
ory, Algorithms, and Applications, Kluwer Academic Publishers, 2000. 

[50] Y.B. Zhao, An approximation theory of matrix rank minimization and its application to 
quadratic equations, Linear Algebra AppL, 437 (2012), pp. 77-93. 

[51] Y.B. Zhao and J. Han, Exceptional family of elements for a variational inequality problem 
and its appliations, J. Global Optim., 14 (1999), pp. 313-330. 



22 



[52] Y.B. Zhao and G. Isac, Properties of a multi-valued mapping associated with some non- 
monotone complementarity problems, SI AM J. Control Optim., 39 (2000), pp. 571-593. 

[53] Y.B. Zhao and D. Li, On a new homotopy continuation trajectory for nonlinear complemen- 
tary problems, Math. Oper. Res., 26 (2001), pp. 119-146. 



23 



